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Abstract 



o 

G 

| We introduce a new notion called generalized dominated splitting which is weaker 

■ than classical dominated splitting. We use this notion to generalize a result of 

Zhang [12]: every diffeomorphism with nontrivial global generalized dominated split- 
ting can not be minimal. 

m 
Q 

ji '. 1 Introduction 

Minimality is an important concept in the study of dynamical systems. It is interest- 
ing to study some nature structure of the system that incompatible with minimality. In 
1980's Herman[3] constructed a (family of) C l diffeomorphism on a compact 4-dimensional 
manifold that is minimal but has positive topological entropy simultaneously and Rees[8] 
constructed a minimal homeomorphism with positive topological entropy on 2-torus. So 

m 



positive entropy is insufficient to guarantee the non-minimality. In [5] Mane gave an ar- 
gument to locate some nonrecurrent point if the map admits some invariant expanding 
foliation (also see [2J). In particular this argument implies that a partially hyperbolic 
diffeomorphism always has some nonrecurrent point and hence can not be minimal. Re- 
cently in [12] Zhang showed that a global dominated splitting is sufficient to exclude the 
minimality of the system. In present paper we mainly want to generalize the result [12] 
j_j ■ to a more general assumption called generalized dominated splitting. 

Let M be a compact D-dimensional smooth Riemannian manifold and let d denote 
the distance induced by the Riemannian metric. Denote the tangent bundle of M by 
TM and denote by Diff x (M) the space of C 1 diffeomorphisms of M. Denote the maximal 
norm of a linear map A by \\A\\ and denote the minimal norm of an invertible linear map 
A by m(A) := Now we introduce our new notion called generalized dominated 

splitting. 
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Definition 1.1. Let f G Diff 1 (M) and let S G N, A > 0. Given an f— invariant compact 
set A, we say a Df— invariant splitting T&M = E © F on A to be a generalized 
dominated splitting on A (or simply GDS), if 

(1) . T&M = E © F is continuous on A; 

(2) . "fnCJf*' 1 ' < A, Vx G A, VA; G N; 

(3) . there exists x G A, "f^jf (xo) l < A -1 . 

Note that \\AB\\ < \\A\\\\B\\, m(AB) >m(A)m(B), \\AB\\ > \\A\\m(B) and m(AB) < 
m(A)\\B\\. Then 

IP/ [|]S k*o)ll x c2S > \\Df n \ EM \\ > P/ [ ^U(»o)ll x C - 2S (L1) 



m( J D/[f] 5 | F(xo) ) " m(i?/»| fW ) " m{Df^ s \ F(xo) ) 

where C = sup xeM max{||D/(a;)||, ||D/ _1 (:e)||}. 

Remark 1.2. By (II. ip the second condition in Definition 11.11 implies that for all a; G A, 

1- 1 i \\ D f n \E{x)\\ 1 ,. 1, HAf" U(s)|l ,1 . n , „, , n 

hm sup - log — — r = - lim sup - log , nfnS , r < ~ mmjlog A, 0} < 0. 

„^+oo n m{Df n \ F{x) ) S n^+oo n m{Df nb \ F{x) ) S 

Recall the definition of classical dominated splitting. Let A be an /—invariant compact 
set. A Df— invariant splitting T&M = E © F on A is called (S, A)-dominated on A (or 
simply dominated), if there exist two constants S G Z + and < A < 1 such that 

IW*<"4 < A , VxGA. 



m(Df 



s\ 



F(x), 



Note that dominated splitting is always continuous (see [T]), A < 1 < A 1 and 

\\ D f kS \E(x)\\ yj \\Df S \E(f*(x))\\ , k . 

m(Df*s\ F(x) ) -^m(DfS\ Wx)) ) ~ ~ " 

So any dominated splitting satisfies Definition 11.1 ( Moreover, we will give an example 
below which does not have global dominated splitting but admits a global GDS). 

Let A be an /—invariant compact set. If ^ A Q M, it is clear that / can not be 
minimal since the closure of every orbit in A is still contained in A. A Df— invariant 
splitting TaM = E © F on A is nontrivial if dim(E) ■ dim(F) ^ 0. And we say a 
Df— invariant splitting T^M = E © F to be global, if A = M. Now we state our main 
theorem for considering systems with global GDS. 

Theorem 1.3. Let f G Diff 1 (Af). If there is a nontrivial global GDSTM = E®F, then 
f can not be minimal. 

Remark 1.4. There exists some minimal system / G Diff 1 (M) such that its nontrivial 
global invariant splitting TM = E@ F only satisfies the first two conditions in Definition 
11.11 More precisely, for a G R, define the corresponding rotation R a : SJ 1 — > S 1 , x i— > 
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x + a(modl). Clearly for the product system f ai ,a 2 ,-,a n '■= R ai x Ra 2 X ••• X R an : 
T n — y T n (ai, a 2 , ■ • • , a n G R), its nontrivial global invariant splitting TM = E @ F 
satisfies the first two conditions in Definition 11.11 for any S G N, A > 1 but fails the third 
condition for all S G N, A > 1 ( "fnlf^l = 1, Vx G A, \/k G N). It is well-known 
that 1,01,02,' •• , CL n G K are rationally independent if and only if the product system 
f ai,a,2,-, a n = Rai x Ra 2 x ■■■ x R an is minimal(and ergodic with respect to Lebesgue 
measure). This shows that both minimal and non- minimal C°° diffeomorphisms admit to 
have nontrivial global invariant splitting TM = E © F satisfying the first two conditions 
in Definition 11.11 

If a global Df— invariant splitting T&M = E © F is not GDS but the first two con- 
ditions in Definition 11.11 still hold for some S, A, then A > 1 and A -1 < m ^ D j k s^ ( \) — 

A, Va; G A, V/c G N. Otherwise, there exists x G A and k , /r, Jfcn gf ; < A -1 , then 



m(Df^\ F(x) ) 

S \e(x )\ 

oi Wo) 

T A M = E © F is GDS for := k S and A. Furthermore, from flU) 



(C^A)- 1 < < C 2S \ Vx G A, Vn G N. 

" m(Df n \ F{x) ) ~ 

II D f n I \ II 

In particular, lim^+oo ^ log m ^ D j n ^ ) = 0, Vs G A. From these analysis and Remark 



11.21 the third condition in Definition 11.11 can be deduced once for some x, 



1, \W 



lim inf — log " ; JL \ < 0. 

■n^+oo n m{Df n \ F{x) ) 

Hence, we state such a corollary of Theorem 11.31 as follows. 

Corollary 1.5. Let f G Diff 1 (M). If there is a nontrivial global Df— invariant splitting 
TM = E © F satisfying the first two conditions in Definition \l.l\ and there exists xq, 



1, \W 



lim inf - log " ' '^ {xo) ' < 0, 

then TM = E © F is a nontrivial global GDS and thus f can not be minimal. 

This corollary can be as a sufficient condition to obtain GDS. By Remark ll.2[ for a 
global (S, A)-dominated splitting, every point x satisfies 

,. 1 , \\F>f n \E(x)\\ 1 . , „ 

hm sup -log < - log A < 0. 

n^+oo n m(Df n \ F ( x )) S 

This implies for any global dominated splitting, every point satisfies the assumption of 
Corollary 11.51 and the supreme limit can be uniformly less than 0. But Corollary 11.51 
assumes only one such point and uses inferior limit. Thus the assumption in Corollary 
11.51 is still weaker than dominated splitting(for instance, see Example 13. II below) . 
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Remark 1.6. For any surface diffeomorphism / with positive topological entropy, if there is 
a nontrivial global Df— invariant splitting TM = E®F satisfying the first two conditions 
in Definition 11.11 then / satisfies Corollary 11.51 and thus / can not be minimal. More 
precisely, by Variational PrincipleQllJ), for any diffeomorphism with positive entropy, 
there exists an ergodic measure \x with positive entropy and thus by Rulle's inequality ([9]) 
\i has both negative Lyapunov exponent (xi < 0) and positive Lyapunov exponent (x2 > 0) 
simultaneously. Note that dim(E) = dim(F) = 1, then for \i a.e. x, 

lim " lo § ll fnl E \ {X) \ =Xi~X2< -2h,(f) < 0. 
n-H-oon m(Df n \ Fix) ) 

In particular, we recall that if / is a C 1+a surface diffeomorphism with positive topological 
entropy, then / always has periodic point by classical Pesin theory jl] and thus can not 
be minimal. 



2 Proof of Theorem 11.3 



Before proving Theorem 11.31 we need a result of [7] . 

Lemma 2.1. (Proposition 3.4 in ^) Let f : X — > X be a continuous map of a compact 
metric space. Let a n : X — >■ R,n > 0, be a sequence of continuous functions such that 

a n +k{x) < a n (f k (x)) + a k (x) for every x G X, n, k > 0. (2.2) 

and such that there is a sequence of continuous functions b n : X — > R, n > 0, satisfying 

a n (x) < a n (f k (x)) + a k (x) + b k {f n {x)) for every x e X, n, k > 0. (2.3) 

If 



1 f 

inf — / a n (x)dfi < 
n Jx 



for every ergodic f-invariant measure, then there is N > such that a^(x) < for every 

xex. 



Proof of Theorem 11.31 If A < 1, then the nontrivial global GDS is a nontrivial 
global dominated splitting. By the result of [12], / can not be minimal. Now we assume 
that A > 1 and we will give a proof by contradiction. Suppose / is minimal, then the 
nontrivial global GDS can not be a nontrivial global dominated splitting from [12J. To 
get a contradiction for this case, we only need to prove that the nontrivial global GDS is 
nontrivial global dominated splitting. 

Define for e > 

A r _ Ttr | \\Df S \E{z)\\ Wl 

A t :={zeM ' < -e + A } 

m(Df b \ F(z) ) 
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and set A = Ue>o^- Note that every set A e is open set and A is also open since the 
splitting TM = E © F is continuous. Clearly by assumption the point x must be in A. 
Take < e < A -1 small enough such that x G A € so that A e ^ 0. 

Since we assume that / is minimal, then for every invariant measure p, its support 
supp(p) must coincide with the whole manifold M. Otherwise, if for some p, supp(p) ^ 
M. Then every point x G supp(p), the closure of its orbit is contained in supp(p) ^ M 
since supp(p) is always compact and invariant. This contradicts that / is minimal. So 
for any nonempty open set, it always has positive measure for any invariant measure. In 
particular, p(A t ) > holds for any invariant measure p. 

Define functions for x G M 



a n (x) := log 



E(x)\ 



m(Df n \ F{x) Y 

Recall that ||AB|| < and m(AB) > m(A)m(B). Then it is easy to see that 

a n satisfy (I2.2p of Lemma 12.11 Taking into account (12. 2p we see that ( 12. 3 p holds once 

•■(j)fk \— i II 

a n (x) < a n+k (x) + b k (f n (x)). This is easily verified for b k (x) := log m((D/fc ^ )) _ 1) since 
IP/ n U(,)ll < \\Df n+k \ E{x) \\ ^ \\(Df k \ E{Mx)) yi\\ 



m(Df»\ F{x) ) ~ m(Df-+k\ F(x) ) m((J)/*| Wj)) )-i) ' 

Recall that TM = i£ © F is a continuous splitting. So a n (x),b n (x) are continuous func- 
tions. Then all assumptions of Lemma [2.11 are satisfied once inf - J M a n (x)dp < holds 
for ergodic invariant measure p. 

Let p be an / ergodic invariant measure. By Subadditive Ergodic Theorem(see 
and the ergodicity of p, the limit function 

a(x) := lim —a n (x) 

n->+oo n 

is well-defined, /-invariant and can be a constant function for p a.e x. Now we prove for 
p a.e x, a(x) < which implies inf ^ J M a n (x)dp < 0. Let $ := U„, g z/ n (^4 e ). Clearly it is 
/-invariant and from ergodicity of p we have that p(<&) = l(In fact, $ = M since M \ $ 
is /-invariant and closed but / is minimal). So we only need to prove a(x) < for p a.e 
x G A t since a(x) is / invariant. Define c n (x) := a n s(x), then 

1 1 

c(x) := lim — c n (x) = S lim —-a n s(x) = Sa(x). 

n->+oo n n->+oo J}D 

So we only need to prove c(x) < for p a.e. x G A=. 
By Birkhoff Ergodic Theorem, the limit function 

n-l 



3=0 



exists for p a.e. x and / s — invariant. Moreover, J x*A e {x)dp = J XaA x )^P = fJ-(A e ). If p is 
f s ergodic, it is obvious since x*aS x ) = / XaX x )^P = n(A e ) > holds for p a.e. x G M. 
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But we do not know whether \x is f s ergodic or not. We only know that it is still / 
invariant. Here we recall a basic fact for recurrent times which is the claim in the proof 
of Proposition 3.1 [5J. This fact is that for any homeomorphism g, if v is (^-invariant and 
T is a set with v(T) > 0, then for v a.e. iGf, 



> 

n—l 



Xr( x ) '■= lim -y2xr{gf{x)) > 



n->+oo n 

3=0 

(Remark that in general this fact holds only for v a.e. x G V and then x G \J n £%g n (T) but 
maybe not hold for v a.e. x G M since v is just ^-invariant). This guarantees that for \i 
a.e. x G A e , Xa e ( x ) > since /i is f s invariant and fi(A e ) > 0. Fix such a point x G A e . 
Let 

i (a) = < ti(x) < t 2 (x) < • • • 
to be the all positive times such that /*»w s (a;) G A e . Then 

i^+co ti(X) U(x)^+oo ti[X) 

Recall the definition of A e and the second condition of GDS. Then 

\\ D f S \EV*jW( x) )\\ < _ e + A -i 



and 



Hence, for n = tAx] 



m ( D f S \ F (f^ s ( x )) 

P /fe+lW -t J W-l)5| g( ^ ws+s ^ ) || 
m(])/ ( tj+1 ( 1 )- tiW -l) S |^. (t)s+S(i)); 

i-i llnj?S| 



< A. 



CnW " l0g m(DfnS\ F{x) ) ~ ^ m(DfS\ F{ftj(x)S{x)) ) 



i ~ 1 f( t i+i( x )- t i( x )- 1 ) s 



ni 



Thus 



J=0 • l "\ J ^J \F(f^ x)b+b (x))> 

< ilog(-e + A -1 ) + 2 log A = ilog(l - eA). 
c(x) = lim — c n (x) < lim - — ^ = x*a ( x ) l°g(l ~~ < 0- 



Remark that x*A e ( x ) > ® anc ^ the estimate inequality of c„(x) play the crucial roles. 

Now we can use Lemma l27Ll to get that there is N > such that ajsr(x) < for every x G 
M. Recall that is a continuous function and M is compact. So t := max xe M{ a N( x )} 
exists and must be negative. If r = e 4 , then < r < 1 and for any x G M, 

W D f N \E(x)\\ = aN{x) <p t = T 

m{Df»\ F{x) ) 
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So the nontrivial global GDS TM = E © F is a nontrivial global (N, r)-dominated split- 
ting. We complete the proof. □ 



Remark 2.2. Note that the assumption of ergodicity of ji is not necessary due to the used 
claim in the proof of Proposition 3.1 [5J. Moreover, if we do not assume / to be minimal 
in the proof, it is easy to see that for any invariant (not necessarily ergodic) measure /x, 
inf i j M a n (x)dfi < if and only if p,{U 6> oA e ) > 0. 

Remark 2.3. This proof implies a fact that if inf ^ J M log ^(Df™^ ) ^ < ^ holds with 
respect to a continuous .D /-invariant splitting TM = E © F for all ergodic invariant 
measure /i, then TM = E © F is a global dominated splitting. 

3 Difference of GDS and Dominated splitting 

To further illustrate the new notion of GDS, we construct a simple example which firstly 
appeared in [10J. This diffeomorphism has global GDS for S — 1, A = 1 but does not have 
global dominated splitting. 



Example 3.1. Let g be a C r (r > 1) increasing function on [0, 1], satisfying: 




Figure 1: Graph of the function g. 

And let h : T 2 — >■ T 2 be the hyperbolic Torus automorphism 

{y, z) ^ {2y + z, y + z), y,z E S 1 = R/Z. 
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Define f = g x h : T 3 -> T 3 . C/eaWj/, 




Df(x,y,z) 



There exists naturally a continuous splitting TT 3 = E\ © E 2 © E 3 , where E 2 and 
E 3 are from the hyperbolic Torus automorphism h and E\ is g— invariant. The forward 
Lyapunov exponent of E\ is log over T 3 — {|} x T 2 and the Lyapunov exponents 
of E 2 © E 3 over {0} x T 2 are log^^, log respectively. Denote by 5 the point 
measure at point G S 1 and denote by m the Lebesgue measure on T 2 , then the product 
measure \x = 5q x m is a hyperbolic ergodic measure of the diffeomorphism f — g x h with 
three nonzero Lyapunov exponents — log , — log ^j^, log ^j^-- Set E = Ei@ E 2 and 
F = E 3 , then E@F construct a continuous Df -invariant splitting ofTT 3 over the whole 
space T 3 and E © F is a GDS for S — 1, A = 1 on the whole space T 3 . However, it is not 
a global dominated splitting since for every point u = z) (y, z G S 1 ), 



\\Df\E(u)\\ 



m(Df\ F(u) ) 3^5 



= 1. 



Similarly if E = E 2 and F — E\ © E 3 , we can follow above discussion to get that the 
new E © F is also not dominated but a global GDS for S = 1, X = 1. But if E = E 1 
and F = E 2 © E 3 , then it is easy to see this splitting E © F is not a global GDS and 
thus is also not a global dominated splitting (even though this splitting is continuous on 
whole manifold). All in all, this example has nontrivial global GDS but does not admit 
nontrivial global dominated splitting. □ 

At the end of present paper, we point out a further question under a more general 
assumption. 

Question 3.2. Let f G Diff^M). If there is a nontrivial global Df— invariant splitting 
TM = E® F satisfying 

(1) . TM = E © F is continuous on A; 

(2) . for every x G M, 



1 , HAT 



lim inf - log " ' f (x) ' < 0; 

n^+oo n m{Df n \ F{x) ) 



(3). there exists x , 



lim inf — log " ; J ,E( - X °' )l \ < 0. 



n^+oo n m(Df n \ F{xi)) ) 
Then whether f can not be minimal? 
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